
IC3 

[magi Segments. 



Tt.il Processing & 
Pattern. Mulching 



)0(, 




Color Images 



Black/ White £•••' Craijkrd 
1 1 n ages 



Extract Text. 



z 



Text Pri)t:tssing £' 
Pattern Mulching 



Crr.nl e AlU I'ilt 



r 



1 10^1 



.IN; /-'/7c 



I mag'; f'rocr.-i.^ing & 

Obj'.cl Rtcilifnition ■ 



Input PDF File 



I 



Extract all text & 
</ietr location 





.'Issoc/ci/e Context. ^J" 
■Kith Text 



■ : 1/" 

Sensitive J 



2o7 



Context Sensitive. 
Pattern Matching 



Create. Alt' File 



y 



Partial MC File 



zo8 




"Fi C^. EL 



Input 



PDF File f 



-3^ 



Extract alt Images & 
their location 



333 




30Z 



Jia mpled/b I ask?, 
sampled 



mask 



3Q5 



3<*\ 



( 



Load External Imaye 



Get lmu<je Pixels 



30& 




Colorf.d 



(.uhrlr.d Inuufi 



Labeled Image, 



-a>-7 Colored Image 



Templates 

7- I ' 



Compute 
Bounding Box 



32 




313 



. Do OCR 







Pattern 
Correction 



3I5- 



Pattern 
Matching 



3<6 



2. 



('oinputc 
;\ r on- text 
Region 



Original U&W/ 
Grayscale fniage 



Break into blocks & 
Compute Histogram 



Break inta blocks &■ 
Compute Histogram 



3|3 
2>2o v 



Match Histogram K 

_r * 



Refine Search 



Binarize 



7r 



I 



Correlate 



323 



T 



Match 



3Z 4 



Create Ml- Pile 



I 



/V/7/h/ Alt- File 



32.5 



•He, .-ab 



M 



3 

ru 

iS 

a 
ru 




. The linear fihn » trm» Co tusariiuo i» tyvcn by 
tbtua into urtfl magr againa which ihe ungate b br- 
tttccuquitd. bcutv thown dwj the maici aaoa* at tlioae 
points that the lerapiaie matches best with thr int»g*- Oe*rty 
tlx pwanwtcn om winch (be fitter outpcd a opcmwri is thf 
displacement. Tfav the ovictKd Old cza Iw iopleminiBd » 
ib n earrebnor with a preprocessing film. For the est *f 
Gawxba nob*, dtfl aba h idrariry. 

Now ** for tix av<hod of the Murch iuei£ there ate two 
•liflercn apnroachrt U ■- 0*uly lb* usi** <ne ii the di. 
ran acucfa approach 1 61 Howner. tt» is feaflT** onJy tor 
relariwly inull images due w the &MnpiiUt»ul CnmplfriJy 
[CHo') for an n x » icarch ml as drtoilvd hriwe. Two 
OifMuuifeil bcarhhtnic search ovtikxb (which biw a audi 
kT«*r logarithmic complexity) cm he used wngnincantlyre. 
dun the tflmpuutiotul o»*rhe*d |6j Howw thr das* 
*)f tau#a thai we «re inKrcced in, tfcU is rnarajucahle » the 
fwmwci thai if nnmiard tt noi ecnwr* e»-en locally for (be 
iii* m r*n Mpfwuinf (he capture rcpon. Thus the gradient 
of Ok anxh erree at any location doesn't necessarily indi- 
cate the <&«ctian In which the search chaild nrugytf *■ TbM 
rafhod* are c»« ■ppnrpriiir fc* image* who gray value*. A 
hiemcbical «am to-6w Mntegy b employed when the ob- 
aerwd hnsgr is wry tiff* tnr a bgari&mic efficiency. Fms 
a coarse, uersioa of the image b comoared again* > nnu- 
lar coarse wrboa of the leozsbte. Far all area* of potential 
nuidk, i« a * v*p»*i n done in thr am higher rcsohflian and *i 
00 1 5 1. The tun idea bohiw* the us* of thU •> called *cak 
space procedure u thil bsporwa fig) 1 * 1 (aojnef »cuki pcraic 
through mhv ia tine icaun Arn ifthev ItxaiVwi cnighi h* 
dipnncd i>icor*hai. Thu« du> atn tM Tracked back din*n tht 
u^ptthiubekuedcKacdyiBthrfeaoacaJe. The oixffttm- 
portani pan of the «^mV tpace itkwry b thr M olUd cauultty 
or nhMk-Mooirit; piopcrty which mat (hat any ftssmre \met 
previa at tonw scale raua aba ht pK»i «l Iowa 
(4. I(. Tbn* «nr a couple of proMena in dimAh/ apfrrtfV 
line mei^)di to imago* taraHlinf of fngtrTtmni, draw tugs 
Ow if that aa itaage <>( a higt» tcale b ottuiiMd by dw Canv- 
tuta«(fcwthingiirdk! image at the l»i«racal*- S«iar « tttsfd 
l« haw thr image proccaard and nored at tewral acalr. tor 
■ taige imgc thv tpwoJwet a bug* mcsiivy rvauiremmi and 
alht tigrtiflfn™ compuuiioo fix tbe Oauxcbn cikMthmg, Fuj- 
iba, for thr case of binary imago tiw might br qwrae, dui 
might actually Ou cornptfUtiorul Awerhead becauw 

all thf Tm^'Witmf imagrs arc tw OkHe binarv. At», this t* 



In thr mat nrfK m go i^mn a farther ciarar in hqe saawgy to 
uJcmify the potini tal natch** *oJ th« miaily test then bathe 
inrn Tt± hi cmfirni ttv auieben. For the caac of nntuns, 
»r deed t> rotatr the icftif>iaU u>d f«rfiorn> tbc aacood «p. 

>J Imatr rnviac 

Ai mAlidned tcfhaiedly N; f.n r. the maia purpaac of (ma 
Mp b U tpncUyndf iw> area* thai u* VEl&ciy U> be cmndi< 
daic ouaffa aftad. 

The bapu image ba coU«n»oa »f bdnry b*« compresaod 
tuiag thr Tif formal Since thb b olVn tno targf to viatlaltw 
■uch a large imag*, we •caic it dnwn in V UUJi of the original 
B». Oh! cvy way u> nlc a down would be just tocarmdrt 
1 out AfABy 4 piifhi in bath, the * aod y dnvctkn. H»> 
rvw, the K»un*ttt uniiv heccaet *p**y «nd bnjk*a. To awad 
tins. w< fim pnvnotc Ihtf image to «re> b*x» fe" binary. a«d 
ibro rr-thmtvUd it adaptnvhr to btfury. Tab ligratkantry 
anptAa thr qjuaKiy uf chr val^d dnwu ifliagt. The iteeshnld 
vtloe is Axnruied adapth«f y far a local »indo*. Tbc bottom 
la%> is Out ai the cunclusion of thb tup, we ooce tgaia end 
up with a bimr* iim« ilheii a much muller one. Wc ehatl 
calltUsimagfl. 

The not cup b u> flihdtvi^ th< output tmag* that wc get 
from the ftfWrtut «*pinw MiM hlocl*. AetoaUy we create 
■a hnagr f t< what each piaei tftvre^M^ to ■ MxM btefc 
of 1. Thr nlur of each pud ia «fu*l u the taaobtfi of Waet 
pLub is dv 64x64 block. Once ihi» U tttatol F« each piirl 
ia f s t . we ux i f the piw:l value b larps than a ^nOaanmed 
tjurshokL tr fo. then we keep the comsrvinding Nocfc in I 
fix further ojnfideratiao, else d b dm raKiderrd funhrr any- 
more. The ct»ic¥ oftlir ihic«bidd can be drpcaden an the 
umpfarw, but can Nr roadtr indciMndeoi of it aa **U. If w« 
kmr« the icinfftiW in x&>vt£X. if »'< find b bn»y Le there 
arc a kUuwIv Urge ournrur dfhiara piaeb, we would n*» * 
rugbrr (hiork.^d than what we Ami ksow me vrqiav apri. 
ori Oihcrwiw wc tae a Value the ihreAftlduNf 12" which 
reprewnis two lines actus* dw block. Thui the ajampuan 
is ibai the utnpiaie u lildy kn br more tbao jiM two liar». 
Cbttily, ta b entirely pondble thai wc might nis vtaoU pans 
of a panes*, buta« wv will see bux. n kiagas aomr parts of 
the fmam a-i a appeals in the image b cull nnda cansidera- 
rtm, we can nfU letrknv the otifoci iocanm. 

FoQcwiAf the abo«« ttw rent .vf the image I that it aQl un- 
der crKHidefaiion f*^. afldt w hawo rulfd out areis Tor Junha 
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